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(54) Three-dimensional sound processing system 



(57) A three-dimensional sound processing system 
which provides a listener with three-dimensional sound 
effects by reproducing a sound image properly posi- 
tioned in a reproduced sound field. A filter coefficient 
enhancement unit creates two difference-enhanced 
impulse responses by emphasizing the difference 
between two sets of acoustic characteristics pertaining 
to a listener's both ears, which are represented as 
impulse responses measured in an original sound field. 
Based on the two difference-enhanced impulse 
responses, a series of coefficients of a sound image 
positioning filter are determined for every possible loca- 
tion of the sound source. A coefficient memory unit 



stores various sets of such filter coefficients separately 
for each sound source location. The sound image posi- 
tioning filter configures itself with the series of filter coef- 
ficients retrieved from the coefficient memory unit 
according to a given sound source location, and adds 
the acoustic characteristics of the original sound field to 
a source sound signal. The sound image positioning fil- 
ter also subtracts in advance the acoustic characteris- 
tics of the reproduced sound field from the source 
sound signal, using a separate set of coefficients repre- 
senting inverse characteristics of the reproduced sound 
field. 
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1 . Field of the Invention 

The present invention relates to three-dimensional sound processing systems, and more specifically, to a three- 
dimensional sound processing system which provides a listener with three-dimensional sound effects by reproducing a 
sound image properly positioned in a reproduced sound field. 

g Description of the Related Art 

To precisely recreate sound images, or to achieve accurate acoustic image positioning, it is necessary in general 
for sound processing systems to acquire acoustic characteristics both in the original sound field where original sound 
is signals are recorded and in a reproduced sound field reproduced from the recorded sound signals. The characteristics 
of an original sound field are expressed by what is known as a head-related transfer function (HRTF). which represents 
relationships between sound signals produced by a sound source and those heard by a listener. The reproduced sound 
field involves some audio output devices such as speakers and headphones, which have some specific acoustic char- 
acteristics. Those characteristics of the original and reproduced sound fields are measured in advance with an appro- 
20 priate procedure and programmed into the sound processing systems. 

When outputting the recorded source sound signals in the reproduced sound field, the sound processing system 
adds the acoustic characteristics measured in the original sound field to those source sound signals. The system also 
subtracts in advance the acoustic characteristics of the reproduced sound field from the source sound signals. Using 
speakers or headphones, listeners can hear the processed sound, where the recreated sound images are positioned 
25 right at the sound source locations in the original sound field. 

FIG 14 shows an example of an original sound field, in which a single sound source (S) 101 and a listener 102 are 
involved As seen in this FIG. 14. there are two spatial sound paths from the sound source (S) 101 to each tympanic 
membrane of the left (L) and right (R) ears of the listener 102. whose acoustic characteristics are expressed by their 
respective head-related transfer function S/. and Sr. 
so FIG 1 5 shows an example of a reproduced sound field which is produced by a conventional sound processing sys- 
tem using a headphone consisting of a pair of earphones. Two filters 103 and 104 with a transfer function (S L . S R ) will 
add to the entered sound signals some acoustic characteristics concerning the sound paths from the sound source 101 
to the listener 102. which are previously measured in the original sound field. The other two filters 105 and 106. on the 
other hand will subtract from the sound signals the acoustic characteristics of sound paths from earphones 107a and 
35 1 07b to both ears of a listener 108. which are represented by a transfer function (h. h). Thus the filters 1 05 and 1 06 have 
the inverse transfer function of (h, h), namely, (ft"', h' 1 ). 

Input signals carrying a sound information identical to the original sound from the sound source 101 . are separated 
into the left and right channels and fed to the above-described filters 103-106. A sound image 109 reproduced by the 
earphone 107a and 1 07b will sound to the listener 1 08 as rf it were placed at just the same location as the sound source 
40 101 shown in FIG. 14. . 

The filters 103-106 are implemented as finite impulse response (FIR) filters, each comprising, as shown in FIG. 16. 
a plurality of delay units (Z 1 ) 110-112 each made up with several flip-flops or the like, a plurality of multipliers 1 13-1 16. 
a summation unit 1 1 7, and an adder 118. Multiplier coefficients aO-an given to the respective multipliers 1 13-1 16 are 
obtained from the acoustic characteristics, or impulse response, of each spatial sound path. To obtain the coefficients 
45 for the filters (S L . S p ) 1 03 and 1 04. the impulse responses should be measured for two spatial sound paths in the orig- 
inal sound field as illustrated in FIG. 14. Todetermine the coefficients for the FIR filters (h 1 . If 1 ) 105 and 106. it is nec- 
essary to measure the impulse responses of two spatial sound paths from the earphones 107a and 107b to both 
tympanic membranes of the listener 108 should be measured and then compute their respective inverse responses. 
More specifically, the impulse responses of the two spatial sound paths from the headphones 107a and 107b to the l.s- 
so tener s both tympanic membranes are measured and transformed into frequency domain, where their respective 
inverse functions are calculated. The calculated inverse functions are then reconverted into time domain to yield the fil- 
ter coefficients. . . 

Such conventional three-dimensional sound processing systems, however, have some shortcomings in their ability 

to position the sound image, as will be clarified as follows. 
55 The human hearing system generally shows low sensitivity in locating a sound source in the vertical and front-to- 
rear directions, while exhibiting excellent ability in the side-to-side direction. Therefore, the listener would use v.sual 
information to locate a sound source in the front-to-rear direction or attempt to detect it by turning his/her head to the 
right or left to cause some difference in sound perception. 
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In the case that the listener is not in the original sound field but in a reproduced sound field, however, it is not pos- 
sible to use visual information because there is no visual image of the original sound source. Even if the listener turns 
his/her head while wearing a headphone, it will cause no change in the acoustic characteristics of the reproduced 
sound field Also, when speakers are used to recreate a sound field, the reproduced sound field is programmed assum- 
5 ing that a listener s head is oriented at a prescribed azimuth angle, and thus the rotation of his/her head will violate th.s 
assumption. 

Therefore, in conventional three-dimensional sound processing systems, it is difficult to achieve effective position- 
ing of a sound image in the front-to-rear direction with respect to a listener. 

The applicant of the present invention proposed a three-dimensional sound processing system in the Japanese 
ro Patent Application No. Hei 7-231705 (1995). According to this patent application, the system computes appropriate fil- 
ter coefficients that approximately represent poles (or peaks) and zeros (or dips) in an amplitude spectrum as partj of 
the frequency-domain representation of an impulse response measured in the original sound field. Using such coeffi- 
cients it is possible to form infinite impulse response (IIR) filters and FIR filters with fewer taps to add the acoustic char- 
acteristics of the original sound field to the reproduced sound field. This filter design technique will reduce the amount 
is of data to be processed by the filters and also enable miniaturization of memory circuits required in the filters. The use 
of such reduced-tap fitters, however, does not always provide sufficient sound image positioning capability in the front- 
to-rear direction. ^ , 

Meanwhile, conventional sound processing systems adjust the amplitude and reverberation of sounds to control 
the distance perspective of a sound image. To adjust reverberation, the systems are equipped with FIR filters having 
coefficients corresponding to an impulse response representing reverberation. Those FIR filters, however, have to proc- 
ess a large amount of data, as well as consuming much memory, in order to achieve their desired performance. 

Conventional sound processing systems also varies the loudness and pitch of a sound to allow the listener to feel 
the motion of a sound image. They simulate the Doppler effect by appropriately controlling the pitch of the sound. That 
is a raised pitch expresses a sound source that is coming close to the listener, while a lowered pitch represents a sound 
source that is leaving the listener. To change the pitch of the sound, conventional sound processing systems employ a 
ring buffer 1 19 as illustrated in FIG. 17. which provides a predetermined amount of memory to temporanly store the 
sound data. The ring buffer 1 19 is equipped with a write pointer to generate a new memory address at a constant oper- 
ating rate, thereby writing sound data into consecutive memory addresses. The ring buffer 1 19 also has a read pointer 
to provide a memory address for reading out the sound data, whose operating rate is controlled according to the 
required pitch of the sound. That is. the read pointer must operate faster to obtain a higher pitch, and slower to yield a 
lower pitch, thus changing the frequency of a sound signal. 

This ring buffer 119. however, has a potential problem of overflowing or underf lowing. When the sound image is 
rapidly approaching the listener, the read pointer will move much faster than the write pointer moves, to create a higher 
pitch to simulate the Doppler effect Just similar to this, when the sound image is rapidly leaving the listener, the read 
pointer will move much slower than the write pointer moves. As a result, the read pointer will overtake the write pointer, 
or vise versa. To prevent this extreme case from happening, the ring buffer 119 must have enough memory capacity, 
which increases the cost of sound processing systems. 

SUMMARY OF THE INVENTION 

Taking the above into consideration, an object of the present invention is to provide a three-dimensional sound 
processing system which enables improved positioning of a sound image. 

Another object of the present invention is to provide a three-dimensional sound processing system which enables 
the distance perspective and motion of a sound image to be controlled with lighter data processing loads and less mem- 
45 ory consumption. ^ . . 

To accomplish the above objects, according to the present invention, there is provided a three-dimensional sound 
processing system which offers three-dimensional sound effects to a listener by reproducing a sound image properly 
positioned in a reproduced sound field. . 
This sound processing system comprises enhancement means, memory means, and a sound image positioning 
so filter The enhancement means creates two difference-enhanced impulse responses by emphasizing a difference 
between two sets of acoustic characteristics represented as impulse responses which are measured in an original 
sound field concerning two spatial sound paths starting from a sound source and reaching the listener s left and right 
tympanic membranes. The memory means determines a series of filter coefficients for each location of the sound 
source based on the two difference-enhanced impulse responses created by the enhancement means. The memory 
55 means' 2 stores such a series of filter coefficients for each location of the sound source. The sound image positioning 
fitter is configured with the series of filter coefficients retrieved from the memory means according to a given sound 
source location. The sound image positioning filter 3 adds the acoustic characteristics of the original sound field to a 
source sound signal, as well as removing the acoustic characteristics of the reproduced sound field from the source 
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sound signal. 

The sound processing system also comprises distance calculation means, coefficient decision means, and a low- 
pass filter. The distance calculation means calculates the distance between the sound image and the listener in the 
reproduced sound field. The coefficient decision means determines coefficients to be used in the low-pass filter, 
s according to the distance calculated by the distance calculation means. Configured with the coefficients determined by 
the coefficient decision means 5. the low-pass filter suppresses the high-frequency components contained in the 
source sound signal. 

Furthermore, the system comprises motion speed calculation means, another coefficient decision means, and a fil- 
ter The motion speed calculation means calculates the motion speed and direction of the sound image, based on var- 
w iations in time of the distance calculated by the distance calculation means. The coeff icient decision means determines 
the coefficients for the f flter. according to the motion speed and direction which are calculated by the motion speed cal- 
culation means. The filter, configured with the coefficients determined by the coefficient decision means, suppresses 
the high-frequency components or low-frequency components contained in the source sound signal. 

The above and other objects, features and advantages of the present invention will become apparent from the fol- 
15 lowing description when taken in conjunction with the accompanying drawings which illustrate preferred embodiments 
of the present invention by way of example. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 FIG 1 is a conceptual view of a three-dimensional sound processing system according to the present invention; 

FIG. 2 is a total block diagram of a three-dimensional sound processing system according to a first embodiment of 

the present invention; . 

FIG. 3 is a diagram showing a filter coefficient enhancement unit that creates a plurality of coefficient groups to be 

stored in coefficient memory means; 
25 FIG. 4 is a diagram showing the internal structure of an image distance control filter; 
FIG. 5 is a diagram showing the internal structure of an image motion control filter; 
FIG 6 is a diagram showing memory allocation in coefficient memory means; 

FIG. 7 is a diagram showing amplitude spectrums AL(<o) and Afl(<o) in the case that a sound source is located in 
the front left direction with respect to a listener, forming an azimuth angle of 60 degrees; 
30 FIG. 8 is a diagram showing a difference-enhanced second amplitude spectrum AL 2 (o>). 
FIG 9 is a diagram showing a variable a(<o) that varies with angular frequency <o; 

FIG. 10 is a diagram showing an difference-enhanced second amplitude spectrum AL 2 (<o) that can be obtained by 
using the variable a(<x>); 

FIG 1 1 is a diagram showing a filter coefficient calculation unit in a second embodiment of the present invention; 
35 FIG. 12 is a diagram showing the internal structure of a filter in the second embodiment, which is used to add the 
acoustic characteristics of the original sound field. 

FIG. 13 is a total block diagram of a three-dimensional sound processing system according to a third embodiment 
of the present invention; 

FIG. 14 is a diagram showing an example of an original sound field where a sound source and a listener are 

40 involved; , . 

FIG. 15 is a diagram showing an example of a sound field recreated through a headphone by using a conventional 

sound processing technique; 

FIG. 16 is a diagram showing the structure of an FIR filter; and 
FIG. 17 is a diagram showing a ring buffer that stores sound data. 

45 

HFSCRIPTION OF THE PREFERRF H FMRODIMENITS 

Several embodiments of the present invention will be described below with reference to the accompanying draw- 
so '"^Referring first to FIG. 1 . the following description will present the basic concept of a first embodiment of the present 
invention. This first embodiment provides such a sound processing system that offers three-dimensional sound effects 
to a listener by reproducing a sound image properly positioned in a reproduced sound field. 

As its primary elements, the system comprises enhancement means 1 . memory means 2. and a sound image posi- 
tioning filter 3. The enhancement means 1 creates two difference-enhanced impulse responses by emphasizing a dif- 
55 ference between two sets of acoustic characteristics concerning two spatial sound paths starting from a sound source 
and reaching the listener's left and right tympanic membranes. Those characteristics in an original sound field are 
measured as impulse responses. The memory means 2 determines a series of filter coefficients for each location of the 
sound source, based on the two difference-enhanced impulse responses created by the enhancement means 1 . The 
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memory means 2 stores such a series of filter coefficients for each location of the sound source. The sound image posi- 
tioning filter 3 is configured with the series of filter coefficients retrieved from the memory means 2 according to a given 
sound source location. The sound image positioning filter 3 adds the acoustic characteristics of the onginal sound field 
to a source sound signal, as well as removing the acoustic characteristics of the reproduced sound field from the source 
sound signal. 

The sound processing system also comprises distance calculation means 4, coeff icient decision means 5. and a 
low-pass filter 6. The distance calculation means 4 calculates the distance between the sound .mage and the listener 
in the reproduced sound field. The coefficient decision means 5 determines coefficients of the low-pass fitter 6. accord- 
ing to the distance calculated by the distance calculation means 4. Configured with the coefficients determined by the 
coefficient decision means 5, the low-pass filter 6 suppresses the high-frequency components contained in the source 

^XSeTmore the system comprises motion speed calculation means 7. another coefficient decision means 8. and 
a filter 9 The motion speed calculation means 7 calculates the speed and direction of a sound image that is moving, 
based on variations in time of the distance calculated by the distance calculation means 4. The cpeffiaent dectsion 
means 8 determines the coefficients of the fitter 9 according to the motion speed and direction calculated by the motion 
speed calculation means 7. The filter 9. configured with the coefficients determined by the coefficient decision means 
8 suppresses either high-frequency components or low-frequency components contained in the source sound signal. 

The above three-dimensional sound processing system will operate as follows. The enhancement means 1 empha- 
sizes the difference of two impulse responses in the original sound field, which represents the acoustic characteristics 
of spatial sound paths from a sound source to the tympanic membranes of a listener's left and right ears. Here, the 
impulse responses of both spatial sound paths are measured in advance through an appropriate measurement proce- 

^This difference enhancement allows the sound image to be positioned better in the front-to-rear (F-R) direction. 
The system performs such enhancement for each location of the sound source and. based on the two difference- 
enhanced impulse responses, determines a series of coefficient values to be used in the sound image posrtion.ng fitter 
3 for each location of the sound source. The determined coefficients will be stored in the memory means 2 separately 
for each sound source position. The memory means 2. therefore, contains a plurality of coefficient groups for different 

sound source positions. „ x _. . u 

According to a given sound image position, the sound image positioning fdter 3 retrieves one of the coefhaent 
groups out of the memory means 2 and configures itself with the retrieved coefficient values. This mates it possible for 
the sound image positioning fitter 3 to add the acoustic characteristics of the original sound field to the source sound 

^"Separately from this, the sound image positioning filter 3 also subtracts in advance the acoustic characteristics of 
the reproduced sound field from the source sound signal, based on the inverse acoustic characteristics of the repro- 

35 duced sound field. . 

In the way described above, according to the present invention, the enhancement means 1 enhances the difference 
of two impulse responses pertaining to two separate sound paths reaching the listener's ears in the onginal sound f.eld. 
thereby yielding improved sound image positioning in the F-R direction in the reproduced sound field. 

Further the distance calculation means 4 calculates the distance between a sound image and listener in the repro- 
40 duced sound field, and the coefficient decision means 5 determines the coefficient values of the low-pass f.tter 6 
according to the distance calculated by the distance calculation means 4. The sound effect brought by this operation is 
as follows 

In general sounds are attenuated while propagating in air. and the degree of this attenuation depends on the fre- 
quency of the sound. The higher the frequency is. the more the sound amplitude will be lost during the travel in air. This 
causes such a phenomenon that the listener will receive a muffled sound from a remote sound source, depending on 
the distance from the listener, because of the attenuation of high frequency components. To simulate this change in the 
frequency spectrum, the sound processing system is equipped with a low-pass filter 6. whose characteristics are pro- 
grammed in such a way that it will vary the degree of treble suppression according to the distance between the sound 
image and the listener. The low-pass filter 6 with such a capability can be implemented as a f irst-order IIR filter, whose 
coefficients are determined so as to cause a deeper suppression of high-frequency components of the sound signal as 

the distance increases. „,;n 
In the way described above, the three-dimensional sound processing system according to the present invention will 
control the distance perspective of a sound image with less data processing loads and memory consumption. 

Furthermore in the present invention, the motion speed calculation means 7 calculates the speed and d.rect.on ot 
a moving sound image based on the temporal change of the sound image distance calculated by the calculation means 
4. The coefficient decision means 8 determines the coefficient values of the fitter 9. according to the calculated motion 
speed and direction. The sound effect caused by this operation is clarified as follows. 

In general, the frequency spectrum of a sound will shift to a higher frequency range when the sound source is 
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approaching the listener and shifts to a lower frequency range when the sound source is leaving the listener. To obtain 
a similar sound effect in the reproduced sound field, the sound processing system configures a filter 9 as a high-pass 
filter to suppress the lower frequency components when the sound image is approaching the listener, while reconfigur- 
ing the fitter 9 as a low-pass fitter to suppress the higher frequency components when the sound image is leaving the 
5 listener. 

In addition to this-dynamic mode switching of the filter 9. the present invention will further control the degree of sup- 
pression depending on the motion speed of the sound image. The coefficient values of the filter 9 are modified so that 
the suppression will be enhanced as the motion speed becomes faster. The filter 9 with such capabilities can be imple- 
mented as a simple first-order IIR filter. 
io In the way described above, the present invention enables the motion of a sound image to be controlled with less 

data processing loads and memory consumption. ( , 

Referring next to FIGS. 2 to 6. the following description will present a specific configuration of the above-described 
first errtoodiment of the present invention. While the structural elements in FIG. 1 and those in FIGS. 2 to 6 have close 
relationships, their detailed correspondence will be separately described after the following discussion is finished, 
is FIG 2 is a total block diagram of a three-dimensional sound processing system according to the first embodiment 
of the present invention. The input sound signal, or a source sound signal, is processed while passing through an image 
distance control filter 1 1 . an image motion control filter 12. a variable gain amplifier 13. and a sound image positioning 
filter 14 Two channel stereo signals are finally obtained to drive a pair of earphones 15a and 15b. From these ear- 
phones 1 5a and 1 5b. a listener 1 6 hears the recreated three-dimensional sound including complex acoustic information 
so added by this sound processing system. ' . . << -^,«,^ 

Here a distance control coefficient calculation unit 17 is connected to the image distance control filter 1 1 under the 
control of a distance calculation unit 1 8. The distance calculation unit 1 8 receives information on the location of a sound 
image and calculates the distance parameter "length" between the sound image and the listener 1 6. Based on the cal- 
culated distance parameter "length", the distance control coefficient calculation unit 17 calculates a coefficient 
25 "coeffjength" through a procedure described later, and sends it to the image distance control filter 1 1 . The image dis- 
tance control filter 1 1 has the internal structure as shown in FIG. 4 to serve as a low-pass filter for controlling the dis- 
tance perspective of a sound image. . 

A motion control coefficient calculation unit 19, coupled to the distance calculation unit 18. provides the image 
motion control filter 12 with its coefficient values. This motion control coefficient calculation unit 19 calculates a coeffi- 
30 cient "coeff_move" through a procedure described later, based on temporal variations of the distance parameter 
"length" calculated by the distance calculation unit 18. The calculated coefficient "coeff_move" is sent to the image 
motion control filter 1 2. The image motion control f jlter 12 with the internal structure as shown in FIG. 5 serves as a low- 
pass or high-pass filter to implement the motion of a sound image into the source sound signal. 

The variable gain amplifier 13 is controlled by a gain calculation unit 20 coupled to the distance calculation unit 18. 
35 This gain calculation unit 20 calculates an amplification gain "g" according to the following equation (1 ). based on the 
distance parameter "length" calculated by the distance calculation unit 18. and provides it to the variable gain amplifier 
13. 

g = a/(1+ b x length) 0) 



40 



where a and b are positive-valued constants. 

Equation (1) shows that the amplification gain g is set to a smaller value as the distance parameter length 
becomes larger With such gain settings, the variable gain amplifier 13 amplifies the source sound signal, working 
together with the aforementioned image distance control filter 1 1 to perform a distance perspective control for the rec- 

45 reated sound image. . 

The sound image positioning filter 14 comprises four FIR filters 14a. 14b. 14c. and 14d The fitters {S L . S R ) 14a and 
14b adds the acoustic characteristics of the original sound field, while the filters (b\ b') 14c and 14d subtract the 
acoustic characteristics concerning the earphones 15a and 15b in the reproduced sound field. The coefficients of the 
filter 14c and 14d have fixed values that are determined from an inverse impulse response representing inverse char- 
so acteristics of the impulse response of the reproduced sound field, which has been measured in advance. 

On the other hand, the coefficients of the filter 14a and 14b are not fixed but dynamically selected from among a 
plurality of coefficient groups stored in the coefficient memory unit 22. according to the location of a sound image. That 
is the coefficient values of the fitters 14a and 14b will vary, depending on the sound image position. For this purpose, 
the coefficient memory unit 22 stores a plurality of group of coefficient values that have been obtained in advance 
ss through an appropriate procedure to be described later on. The values for each sound source location are packaged in 
a contiguous address space. This allows a pointer calculation unit 21 to locate and retrieve a group of coefficient values 
corresponding to each location of the sound source by simply designating the starting address of the contiguous 
address space. 
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FIG 3 shows a filter coefficient enhancement unit that creates a plurality of coefficient values to be stored I in the 
coefficient memory unit 22. The filter coefficient enhancement unit comprises a fast Fourier transform unit (FFT) 23 and 
!n^se FfTu^(FFT) 24 for the .eft ear. an FFT unit 25 and inverse FFT unit 26 for the right ear. and an ear-to-ear 
difference enhancement unit 27. ■ « a *K C 

For every possible sound source location in the original sound field, the impulse r ^ ons ^ A c ^f!, t, ^"i^^ 
from L souT source to listeners both tympanic membranes are measured ad^nce_ 
responses obtained in the measurement, impulse responses of the left ear are subjected to the FFT Mt 23 to ^crea te 
^respective phase spectrums and amplitude spectrums that show its clwactenst.es n the taq^«wJ Uke 
wise. frnpu.se responses of the right ear are subjected to the FFT unit 25 to create the,r respective phase spectrums 

W ^ T^'^afdTCence enhancement unit 27 receives from the FFT units 23 and 25 a pair of amp^e spec, 
trumsS Shears for each sound source location. The amplitude spectrums of the left and nght-ear responses are rep- 
es^X ^ons AL(a>) and Afl«o). respective.* where <o is an angular frequency ranging 0* ^ 
^sysVe^s sampling frequency. The ear-to-ear difference enhancement unit 27 calculates a first amplitude spectrum 
,5 ^SSrdtnTto LSJowing equation (2). This Equation (2) enhances the .eft-ear amphtude spectrum AL(<o) by 
the difference between the two amplitude spectrums AL(a>) and AR(a). 

log[AL,(co)] = .ogIAL(to)] + a{log[AL(o))]-log[Afl(a))]} < 2 > 

20 where a is a positive-valued constant. Note here that the difference enhancement calculation is done in the 'o^™ 
s^e whereSplicatJon and division of two variab.es are expressed as addition and subtract™ of their 'ogan^ 
. TfTdifLence-enhanced first amplitude spectrum logfAL ,«o)] is then converted to a ..near-scaled value according 
to the following equation (3). 

2S AL f (o») = exp(.og[AL,(co)]) (3) 

Furthermore, some level adjustment in the frequency domain is applied to the first .a mplitude spectrum AL,(«) 
according to the following equation (4). thereby obtaining a second amplitude spectrum ALg») The <*^™»£ 
amplitude spectrum AL 2 «») is then supplied to the inverse FFT unit 24 As an >><"^£«£^ J? ■** 
me* can also be achieved in the time domain after the sound s.gnal is processed by the inverse FFT unit 24. 

AL 2 (<d) = AL,(<a) x (MAX[ AL (to)] / MAXfAL , (co)l) ( 4 > 

where the function MAX[AL«o)] represents the maximum value of the original amplitude spectrum AL(«) within the 
range of OM. and the function MAX[AL,(co)] shows the maximum value of the difference-enhanced f,rst amplrtude 
spectrum AL,(to) within the range of Osc^ic. a _ =- to 

The amplitude spectrum Afl(co) entered to the ear-to-ear difference enhancement unit 27 ,s ^f^' 5 *™ 
inverse FFT unit 26 according to the following equation (5). which output signal is referred to as a second amplitude 
spectrum Af? 2 (co). 

AR 2 {a) = Afl (co) (5) 

The inverse FFT unit 24 performs an inverse fast Fourier transform for the phase spectrum sent from the FFT unit 
23 and the second amplitude spectrum AL 2 {«>) sent from the ear-to-ear difference enhancement unit 27. thereby 
oota"^^^ 

Fourier fransform for the phase spectrum sent from the FFT unit 25 and the second amplitude spectrum AR 2 £) sent 
IZZe^A^eatmJence enhancement unit 27. thereby obtaining a right-channel impulse response ,n the t,me 

d0 "rne above-described difference enhancement process is executed for each location of the sound source, and the 
differenceThancId impulse responses obtained through the process are stored into the coefficient memory un.t 22 
seoaratelv for each sound source location. , , . . 

.String next to FIGS. 7 and 8. the following description will explain a different aspect of the above-desenbed d.f- 
forenrp pnhancement performed by the ear-to-ear difference enhancement unit 27, 

^S^SSTTiS* of the amplrtude spectrums AL(co) and Afl(co). which are obtained in such a sound Md 
^^SZ^Zm in the front left direction at the 60-degree azimuth angle. When *~ ^J^^ 
Turn ,AU<o) and Aft(co) are applied to the above-described ear-to-ear difference enhancement unit 27 the resultant 
se^nd aLXe spSrum S«) as indicated by the so.id in. in F.G. 8. For comparison. F.G. 8 a.so shows 

the original amplitude spectrums AL(g>) with a broken line. 
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As seen in FIG. 8. the difference-enhanced amplitude spectrum AL 2 (v>) is boosted particularly at a high angular fre- 
quency range when compared with the amplitude spectrum AL(a>) before enhancement. Such an enhancement meets 
a characteristic of the human hearing system, in which high frequency components play an important role in locating a 
sound source in the F-R direction. As a result of the ear-to-ear difference enhancement, the sound processing system 
according to the present invention provides an improved positioning of a recreated sound image. 

In the above-described first embodiment, the ear-to-ear difference enhancement unit 27 is configured to emphasize 
the left^ear amplitude spectrum AL(o>) by the difference between the amplitude spectrums AL{<a) and AR(a>). while 
maintaining the right-ear amplitude spectrum /\fl(to) as is. As an alternate arrangement, the ear-to-ear difference 
enhancement unit 27 can also be configured so that it will enhance the right-ear amplitude spectrum AR(a>) by the dif- 
ference between the two amplitude spectrums AL(a>) and AR{n). while keeping the left-ear amplitude spectrum AL{a) 



as is 



As a still another alternative arrangement the ear-to-ear difference enhancement unit 27 can be configured so that 
it will calculate an average response curve between the left and right amplitude spectrums AL(a>) and AR(a>). and 
enhance the both amplitude spectrums AL(«) and AR(a)with respect to the average amplitude response. 

As a further alternate arrangement, the ear-to-ear difference enhancement unit 27 can be configured so that it will 
enhance the left-ear amplitude spectrum AL(<d) by the difference between the two amplitude spectrums AL(a») and 
AR(<a) using the same equations (2)-(5) except that the multiplier o in Equation (2) is not constant but controlled as a 
function of the angular frequency <o. namely. o(«>). See FIG. 9. for example, where the value of th.s function «(<*) is 
raised as the angular frequency a> increases. By substituting such a value a(oa) for the constant a. Equation (2) will yield 
a difference-enhanced second amplitude spectrum AL 2 (a>) as shown in FIG. 10. 

FIG 6 shows memory allocation in the coefficient memory unit 22. Assume that the impulse responses are meas- 
ured at every 30 degrees azimuth angle of the sound source relative to the listener's position, where 0 degree azimuth 
is directly in front of the listener, and 180 degrees azimuth is directly in the rear of the listener. The coefficient memory 
unit 22 stores the measured data for Oslegree. 30-degree.... 180-degree azimuth angles in their dedicated storage 
areas 22a 22b 22c respectively. Each storage area has a plurality of memory cells with contiguous addresses start- 
ing from their respective top addresses 22d. 22e,... 22f. which is selectable with an address pointer, when one of those 
top addresses is specified by the address pointer, a set of coefficients saved in the corresponding storage area are 
retrieved and sent to the raters 1 4a and 14b shown in FIG. 2. In the way described above, the sound image positioning 
filter 1 4 can achieve excellent positioning of the sound image. . 
Next, the following description will explain a distance control process executed by the distance control coefficient 

calculation unit 1 7. . „ 

The distance control coefficient calculation unit 17 calculates the coefficient "coeffjength" according to the follow- 
ing equation (6), using a distance parameter "length" sent from the distance calculation unit 18. 

coeffjength = a , x [1 - (1 + 6 , * length) ' 1 ] ( 6 ) 

where ai and are constants ranging 0<a-,<1 and 0<Bj . respectively. 

This Equation (6) means that the coefficient "coeffjength" converges to a constant value a, as the <^™* 
parameter "length" increases, and it also converges to zero as the distance parameter "length" becomes smaller. The 
coefficient "coeffjength" having such a nature is sent to the image distance control filter 11. 

FIG 4 shows the internal structure of the image distance control filter 1 1 . The image distance control filter 1 1 com- 
prises a coefficient interpolation filter 1 1a and a distance effect filter 1 1b. Those two filters 1 1a and 1 1b are both first- 
order IIR low-pass filters. The coefficient interpolation filter 1 1 a avoids abrupt variation of the coeff laent "coeffjength 
and provides a smooth change of the coefficient 

When the three-dimensional sound processing system is coupled to. say. a computer graphics application running 
on a personal computer, the sound image location cannot be updated frequently enough, because of a large amount of 
data processing load of the computer graphics imposed on the personal computer. As a resutt. the coefficient 
"coeffjength" provided by the distance control coefficient calculation unit 17 loses time-continuity and exhibits a sud- 
den change in its magnitude. The coefficient interpolation filter 11a. having a low-pass response, recedes such a time- 
discontinuous coefficient "coeffjength" and outputs the smoothed values. 

The coefficient interpolation filter 1 1a comprises two multipliers 1 1aa and 1 1 ab and other elements to form a first- 
order IIR low-pass filter. The multiplier 11aa multiplies the output signal of a delay unit (T ) by a constant .' 
(0<y<1) which determines how deeply the high-frequency components will be suppressed. The mult.plier 1 1ab multi- 
plies a constant factor (1-y) so that the coefficient interpolation filter 1 la will maintain a unity gam in the DC range. The 
interpolated output from the coefficient interpolation fitter 1 1a is named here as the coefficient "coeffjength-, which is 
supplied to the distance effect filter 11b. 

The distance effect filter 1 1b is composed of two multipliers 1 1ba and 1 1bb and other elements to form a f.rst-order 
IIR low-pass filter as in the coefficient interpolation filter 1 1a. The multiplier 1 1ba multiplies the output signal of a delay 
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unit (Z- 1 ) by the smoothed coefficient ' coeff Jength" received from the coefficient interpolation f.lter 1 a thereby sup- 
oressing the high-frequency components of the source sound signal entered to the image distance confrol filter 1 1 The 
the inpTsignal by the value (1 -coeff Jength') so that the distance effect filter 1 1b will mamta-n 

a unity gain in the DC range. 

ThP dearee of this high-frequency suppression is determined by the value of the smoothed coefficient 

' • JFUT s a £e Snce parameter "/enofn" becomes larger, me coefficient converges 
to me^ue a, as clarified above, and this will resu.t in an increased suppression of high «^ m ™*™£ of the 
source sound signal. In turn, a smaller distance parameter 'length' will cause the coefficient coeff .length to be 
dec eased thereby reducing the suppression of high-frequency components contained in the source sound signal. 

,* S pfJouJ mention* . souShaving higher frequencies are more likely to be *« enu ^;^^ 

air ami thus the listener will receive a muffled sound from a remote sound source because of the attenuat.cn of high 
frequency components. The distance effect filter 1 1b just simulates this nature of ^ .._ fiCheme 
Since it is possible to fully realize the image distance control filter 1 1 by using a simple f irst-orie r ^IIR f ilte ^em* 
the fl!SI controls the distance perspective of a sound image with a smal.er amount of data processing and 

' 5 Zl^tZSIZ^ will explain a process performed by the motion control coeffideri I catenation unrt 19. 
^SSSSS!SMmiL calculation unit 19 receives a distance parameter 'length' £ 
Hon «3 « The distance calculation unit 18 first calculates the difference between the <^.< Mara ^^ 
Z«T and the previous distance parameter "length _ol<T to obtain the motion speed .n the sound image i. The i**nc. 

20 calXion unit 18 then computes a coefficient 'coeff _move" based on the following equations (7a) and (7b). cons.de, 
ing the polarity (positive/negative) of the motion speed. 

If (length - length_old) >0. coeff.move = a 2 x [1 - (1+p 2 x[/eng/h - length_old]) (7a) 
If (length - length_old) <0 coeff_move = -e 2 x [1 - (l + p 2 *[feng<n_o« - length]) *] (7b) 

where constants a, and fe are constants ranging 0<a2<1 and 0<p2. respectively. . . . aoo 

EqSon (7a)?ndk*«8 that when the motion speed {length-length_old) is posrtrve (i.e when the sound .rrage.s 
.eaviSTeTstener). the coefficient 'coeff_move" converges to a constant value « 2 as the absolute value of *e rmrtion 
SeXnaTh^gth old\) becomes larger. Similarly. Equation (7b) shows that, when the motion speed ^ negative 
K rihS tne soCnd km£ is approaching the listener), the coefficient "coeff _move' converges to a constant value <- 
S3" as £ motion speed becomes larger. Further. Equations (7a) and (7b) both ind.cates that coefficient 

SJ? wTconverge to zero as the absolute motion speed becomes smaller. The motion contrd coefficient a* 
££to™^ZZes the coefficient 'coeff.move' having such a nature and sends it to the image mot,on control fitter 

12 FIG 5 is a diagram showing the internal structure of the image motion control filter 12. The image motion control 
filter i?'«^r1^^8n^ Irterp^ filter 12a and a motion effect filter 12b. The coefficient interpolate fi ter 
SaislfiX^ 

when a positive-valued coefficient is given, and serves as a high-pass filter when a negat,ve-valued coeff .cent is 

40 Tte coefficient interpolation filter 12a is a filter that converts a steep change in the coefficient 'coeft ' move" into a 
waS^m^sSLf to the coefficient interpolation filter 11a explained in FIG. 4. some ^.scontinuous 
ch^nqS ^ ha^en to the value of the coefficient " coeff _move' supplied from the motion control coefficient calcula- 
tic^lT^^ ««ter 12a accepts such a discontinuous coefficient *coeff_move' and removes 

.s hJh^uenTy con^nS wrth'its low-pass characteristics, thereby outputting a smoothed coefficient "coeff .move 

X °*i™Z«t£* imerpoTation filter 12a contains two multipliers 12aa and 12ab. The multipUcation coeff iaenty" 
(0<r'<T) Spliid to the multiplier 12aa determines the low-pass characteristics of this filter, and the multpher 12ab 

interna, feedback signal by the smoothed coefficient «™J 
coeffLnt interpolation fitter 12a. thereby suppressing the high-frequency or t vie" (1 

sound input signal according to the polarity of the coefficient value. The mutt.pl.er 12bb multiplies the value (1 
coeff move') so that the motion effect filter 12b will maintain a unity gain in DC range, 
ss Sicily exp Gained, when the motion speed (length-length _old) is positive (i.e.. when the sound image •tak- 
ing t^Sne^ .^coefficient "coeff _move" converges to a constant value «, as the absolute value of the motion 
speed I ( Venom' length old\) becomes larger. This will result in greater suppression of high-frequency conponents 
Wh2 nt?n the motion speed is negative (i.e.. when the sound image is approaching the listener), the coefficient 
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■coefi_move- converges to a negative constant value (- a 2 ). as the absolute value of the motion speed becomes larger. 
This will result in greater suppression of low-frequency components by the motion effect filter 12b. Further, as the abso- 
lute value of the motion speed becomes smaller, the coefficient "coeff_move' will converge to zero regardless of 
whether the motion speed value is positive or negative, thus reducing the degree of high- or low-frequency suppression. 

In summary, the motion effect filter 12b suppresses the high-frequency components of the sound signal when the 
sound image goes away, and enhances this suppression for higher motion speeds. When the sound image is approach- 
ing to the listener, the motion effect filter 1 2b suppresses in turn the low-frequency components, and enhances this sup- 
pression as the motion speed is increased. 

Generally the frequency spectrum of a sound signal shifts to a lower frequency range when the sound source is 
leaving the listener, while shifting to a higher frequency range when the sound source is approach.ng the listener. By 
performing the above-described control, the motion effect filter 12b simulates this nature of approaching or leaving 

S ° U Since it is possible to fully realize the image motion control filter 1 2 by using simple first-order IIR filters as illustrated 
in FIG. 5. the present invention controls the motion of sound images with a smaller amount of data processing and less 
memory consumption. 

The constituents of the above-described first embodiment are related to the structural elements shown in FIG. 1 as 
follows. The enhancement means 1 shown in FIG. 1 corresponds to the filter coefficient enhancement unit shown in 
FIG 3 The memory means 2 in FIG. 1 corresponds to the coefficient memory unit 22 in FIG. 2. and similarly, the sound 
image positioning filter 3 to the sound image positioning filter 14. the distance calculation means 4 to the distance cal- 
culation unit 18. the coefficient decision means 5 to the distance control coefficient calculation unit 1 7. the low-pass filter 
6 to the image distance control filter 1 1 . the motion speed calculation means 7 to the motion control coeff icient calcu- 
lation unit 19. the coefficient decision means 8 to the motion control coefficient calculation unit 19. and the filter 9 to the 
image motion control filter 12. . . „ 

Referring next to FIGS. 1 1 and 12. the following description will explain a second embodiment of the present inven- 
tion. Since the structure of the second embodiment is basically the same as that of the first embodiment the following 
description will focus on distinct points of the second embodiment. „. . . 

In the second embodiment the system employs a filter coefficient calculation unit coupled to the fitter coefficient 
enhancement unit explained in the first embodiment. The second embodiment also differs from the first embodiment in 
the internal structure of trie filters 14a and 1 4b. _. .... „ 

FIG 1 1 is a diagram showing the filter coefficient calculation unit proposed in the second embodiment. This filter 
coefficient calculation unit is a device designed to process each of the two impulse responses produced by the filter 
coefficient enhancement unit shown in FIG. 3. In FIG. 1 1. the filter coefficient calculation unit receives one of he two 
impulse responses pertaining to the listener s left and right ears, which are measured in advance in the original sound 
field The received impulse response is delivered to a linear predictive analysis unit 28 and a least square error analysis 
unit 30 The linear predictive analysis unit 28 calculates the autocorrelation of the entered impulse response to yield a 
series of linear predictor coefficients bp 1 . bp2.... bpm. The Levinson-Durbin algorithm, for example, can be used in this 
calculation of linear predictor coefficients. The linear predictor coefficients b P 1.bp2.... bpm obtained through this proc- 
ess will represent the poles, or peaks, involved in the amplitude spectrum as part of the entered impulse response. 

With those linear predictor coefficients bp1. bp2.... bpm calculated by the linear predictive analysis unrt 28 are then 
set to an IIR-type synthesizing filter 29 prepared for recreation of some intended acoustic characteristics. When applied 
an impulse the synthesizing filter 29 will produce a specific impulse response "x" where the added poles take effect. 
This impulse response "x" is supplied to a least square error analysis unit 30. along with the impulse response a 
entered to the filter coefficient calculation unit. ^ .. u «• 

The least square error analysis unit 30 is a device designed to calculate a series of FIR filter coefficients bzO. 
bzl.... bzk that represents zeros, or dips, in the amplitude spectrum as part of the impulse response entered to the filter 

coefficient calculation unit of FIG. 11. 

The following Equation (8) shows the relationship between the impulse response "a" represented as a vector [aO. 
ar .... aqf (q a 1) and the filter coefficients represented as a vector [bzO, tet .... bzk] J where superscript T indicates a 
transpose. 
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xO 0 0 

xl xO 0 



xk xk-1 



xq xq-1 



xO 



xq-k 





bzO 




aO 




bzl 




al 
















ak 




bzk 




* 

aq 



(8) 



where xO. x1 xq are elements representing the impulse response "x". 

By naming the left part matrix as X. this Equation (8) can be simply rewritten as 



Xb 



(9) 



where a and b are vectors representing the filter coefficients and the impulse response, respectively. Multiplying both 
parts by a transposed matrix X T will lead to 



X T Xb = X T a 



(10) 



Then Equation (10) yields 



(X T X)" 1 X T a 



01) 



Based on this Equation (11). the least square error analysis unit 30 calculates the filter coefficients bzO bzl bzk. 
Here, the least square error analysis unit 30 can be configured such that it will solve the coefficient bzO. bzl .... bzk toy 
using steepest descent techniques. 

The filter coefficient calculation unit of FIG. 11 also executes the same process for the remaining one of the two 
impulse responses provided from the filter coefficient enhancement unit of FIG. 3. thus producing the linear predictor 
coefficients opr. bp2,... bpm representing poles and the filter coefficients bzO. bzl.... bzk representing zeros 

FIG 12 shows the internal structure of filters implemented in the second embodiment as alternatives to the filters 
14a and 14b in the first embodiment. Since the two filters for L and R channels have identical structure. FIG. 12 shows 
the details of only one channel. 

The filter actually contains two filters connected in series: an IIR filter 31 and FIR filter 32. The first filter 31 has the 
linear predictor coefficients opr. b P 2,... bpm provided by the linear predictive analysis unit 28. while the second filter 
32 has the coefficients bzO. bzl,... bzk supplied by the least square error analysis unit 30. . ^ . 

This filter configuration will dramatically reduce the number of taps, when compared w,th the filters 1 4a and 1 4b n 
the first embodiment which requires several hundreds to several thousands taps to reproduce the origrna sound field 
characteristics. Such a configuration in the second embodiment is a combination of the first embodiment of the present 
invention and the sound processing technique which is proposed in the Japanese Patent Application No. He. 7-231705 
by the applicant of the present invention. 

Referring next to FIG 13. the following description will explain a third embodiment of the present invention where 
speakers are used instead of the headphone to recreate a sound field. FIG. 13 is a total block diagram of a three-dimen- 
sional sound processing system where the present invention is embodied. Since the structure of the third embodiment 
is basically the same as that of the first embodiment, the following description will focus on its distinct points, while main- 
taining like reference numerals for like structural elements. 

Unlike the preceding two embodiment, the third embodiment recreates a sound field with speakers 33 and 34. A 
sound image positioning filter 36 comprises two filters 36a and 36b having transfer functions T L and r R expressed as 
the following equations (12a) and (12b). respectively. It should be noted here that the two speakers 33 and 34 are 
placed at symmetrical locations with respect to a listener 35. 

T L =(S L L L -S R L R )«L L 2 -L R 2 ) 02a) 
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T R = (S R L L -S L L R )KL L 2 -L R 2 ) 02b) 

where S, and S R are head-related transfer functions representing the acoustic characteristics of res P^ ve s°" nd f 
paths in the original sound field from the sound source to the listeners tympanic membranes as described '"the first 
Embodiment. The symbols L L and L R are also head-related transfer functions which represent the acoust.c character- 
istics from the L-ch speaker 33 to both tympanic membranes of the listener 35. 

The head-related transfer functions S L and S R as part of the above transfer functions T L and T R are P^rammed 
into the filters 36a and 36b as a set of coefficients retrieved from the coefficient memory unrt 22 for a 9'ven sound I image 
location. Those coefficients are originally created by the filter coefficient enhancement unit in the f.rst embodiment. 

Even in such a sound field produced by the speakers 33 and 34. the improvement of sound ^j***™^ 
the F-Rdirection. which is what the first embodiment realized using a headphone, can be accomplished ^^«™0 
the filters 36a and 36b with the coefficients created by the filter coefficient enhancement unit in the way clarrf.ee I above 

As a further variation of the first to third embodiments of the present invention, the degree of ear-to-ear difference 
enhancement concerning the head-related transfer functions can be controlled according to the soundimage .tocm* 
Specifically, the value o^x. the maximum value of aW in FIG. 9. w.11 be vaned according to the location of a sound 

"^The above discussion will be summarized as follows. Rrst. according to the present invention, enhancement 
means enhances the difference in impulse response between two sound paths reaching 1 h. k ^^^J^J 
inal sound field, thereby yielding improved positioning of a sound image .n the F-R d.rection ,n the reproduced sound 

"""'second coefficient decision means determines a series of coefficient values for a low-pass filter depending on the 
distance between the listener and the sound image in a reproduced sound field. The degree of "ph-f^uency ' cornpo- 
nent suppression is controlled according to the sound image distance from the listener. T^«^«£ 
the sound that the listener will receive a treble-reduced sound when the sound image is located far from the listener As 
a reS the sound processing system according to the present invention can place recreated sound .mages at proper 
dte^cesas^ey were originally heard. A simple first-order I.Rfilter can serve as the l°wjpass filter requir ed .n thissys- 
Srn Mto provide the above sound effects. Therefore, the present invention makes it possible to control the d.stance per- 
spective of sound images with a smaller amount of data to be processed and less memory consumpbon. compared wrth 

^^acSSnTto the present invention, coefficient decision means determines a series of ^coeffiaents .for 
motion control, based on the speed and direction of a moving sound image. This filter works as a h.gh- P ass itter that 
Oppresses the low-frequency components when the sound image approaches the listener, while serving in turn as a 
TcJ^pass filter to suppress the high-frequency components when the sound image goes away In addrtion. the f .Her coef- 
f^entvalues are raised as the sound image moves faster, thereby increasing the degree of the suppression. Such a 
Ngh pass or low-pass filter can also be realized as a simple fi^ 

processing system of the present invention enables the distance perspective and moton of a sound .mage to be con- 

trolled with less data processing loads and memory consumption. 

-T^e foregoing is considered as illustrative only of the principles of the present invention Further. S'"ce "umerous mod- 
ifications and changes will readily occur to those skilled in the art. it is not desired to hmit the .nvention to ^ exact con- 
struction and applications shown and described, and accordingly, all suitable modrf.cat.ons and equivalents may be 
regarded as falling within the scope of the invention in the appended claims and the.r equivalents. 



Claims 
1. 



A three«iimensional sound processing system which provides a listener with three<limensional sound effects by 
reproducing a sound image properly positioned in a reproduced sound field, comprising: 

enhancement means for creating two difference-enhanced impulse responses by emphasizing a difference 
between two sets of acoustic characteristics represented as impulse responses measured in an or.g.nal sound 
field concerning two spatial sound paths from a sound source to a listeners left and nght tympamc mem- 

branes * 

memory means for determining a series of filter coefficients for each location of the sound source based on 
the two difference-enhanced impulse responses created by said enhancement means, and storing the series 
of filter coefficients for each location of the sound source, and 

a sound image positioning fHter. configured with the series of filter coefficients retrieved from sad memory 
means according to a given sound source location, for adding acoustic characteristics of the original sound 
field to a source sound signal and for subtracting in advance acoustic characteristics of the reproduced sound 
field from the source sound signal. 
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2 A three<iimensiona> sound processing system according to claim 1 . wherein said f"*™*^ 

sizes the difference between the two acoustic characteristics based on a difference in ^^^^^ 
fmpulse responses measured in the original sound field concerning the two spatial sound paths from the sound 
source to the listener's left and right tympanic membranes. 

3. A three-dimensional sound processing system according to claim 1 . wherein 
said sound image positioning filter comprises 

an IIR filter configured with linear predictor coefficients representing poles determined through linear pre- 
dictive analysis of the two difference-enhanced impulse responses and , ^ 
Z TrR Ser^nf igured with filter coefficients representing zeros determined by using a least square error 

method, and 

said IIR and FIR fitters connected in series perform the addition of the acoustic characteristics of the original 
sound field to the source sound signal. 

4. A threendimensional sound processing system according to claim 1 . further comprising: 
distance calculation means for calculating distance between the sound image and the listener in the repro- 

S means for determining coefficients according to the distance ca.cu.ated by said distance 

tSUS^ Soured with the coefficients determined by said coefficient decision means, for suppress- 
25 ing high-frequency components contained in the source sound signal. 

5 A three-dimensional sound processing system according to claim 4. wherein said coefficient decision means deter- 
mJnes^efficients so that the high-frequency components will be more suppressed as the d,stance calculated 
by said distance calculation means becomes longer. 

6. A three-dimensional sound processing system according to claim 1 . further comprising: 

distance calculation means for calculating distance between the sound image and the listener in the repro- 

n^ton^cticulation means for calculating motion speed and motion direction of the sound image, based 
on variations in time of the distance calculated by said distance calculation means 

coefficient decision means for determining coefficients according to the motion speed and the mot.on d.rection 

which are calculated by said motion speed calculation means, and 

IflW coSgured with the coefficients determined by said coefficient decision means, for suppressing h,gh- 
frequency components or low-frequency components contained in the source sound signal. 

A three-dimensional sound processing system according to claim 6. wherein said ^^J^^^E 
mines the coefficients so that said filter wil! suppress the low-frequency components conta ned hn_ the source sound 
signal when the motion direction calculated by said motion speed calculation means .ndicates that the sound .mage 
45 is approaching the listener. 

8. A three-dimensional sound processing system according to claim 6. wherein said 

mines the coefficients so that said fitter will suppress the high-frequency components contained n , the source 
STdund signal when the motion direction calculated by said motion speed calculation means .ndicates that the sound 
so image is leaving the listener. 

9. A three-dimensiona. sound processing system according to claim 6. wherein said 

mines the coefficients so that said filter will enhance the suppression as the motion speed calculated by said mot.cn 
speed calculation means increases. 

55 10 A tridimensional sound processing system which provides a listener with three-dimensional sound effects by 
" reproducing a sound image properly positioned in a reproduced sound field, comprising: 
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distance calculation means for calculating distance between the sound image and the listener in the repro- 
duced sound field; 

coefficient decision means for determining coefficients according to the distance calculated by said distance 
calculation means; and 

a low-pass filter, configured with the coefficients determined by said coefficient decision means, for suppress- 
ing high-frequency components contained in a source sound signal. 

11. A three-dimensional sound processing system which provides a listener with three-dimensional sound effects by 
reproducing a sound image properly positioned in a reproduced sound field, comprising: 

distance calculation means for calculating distance between the sound image and the listener in the repro- 
duced sound field; 

motion speed calculation means for calculating motion speed and motion direction of the sound image, based 
on variations in time of the distance calculated by said distance calculation means; 

coefficient decision means for determining coefficients according to the motion speed and the motion direction 
which are calculated by said motion speed calculation means; and 

a filter, configured with the coefficients determined by said coefficient decision means, for suppressing high- 
frequency components or low-frequency components contained in the source sound signal. 

12. A three-dimensional sound processing system which provides a listener with three-dimensional sound effects by 
reproducing a sound image properly positioned in a reproduced sound field, comprising: 

memory means for storing a predetermined series of filter coeff icients for each location of a sound source; and 
a sound image positioning filter, configured with the series of filter coefficients retrieved from said memory 
means according to a given sound source location, for adding acoustic characteristics of an original sound field 
to a source sound signal and for subtracting in advance acoustic characteristics of the reproduced sound field 
from the source sound signal. 
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